HARMONIC ANALYSIS, ERGODIC THEORY AND 
COUNTING FOR THIN GROUPS 

HEE OH 

Abstract. For a geometrically finite group r of G = SO(n, 1), 
we survey recent developments on counting and equidistribution 
problems for orbits of T in a homogeneous space H\G where H is 
trivial, symmetric or horospherical. Main applications are found in 
an affine sieve on orbits of thin groups as well as in sphere counting 
problems for sphere packings invariant under a geometrically finite 
group. In our sphere counting problems, spheres can be ordered 
with respect to a general conformal metric. 
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1. Introduction 

In these notes, we will discuss counting and equidistribution prob- 
lems for orbits of thin groups in homogeneous spaces. 

Let G be a connected semisimple Lie group and H a closed subgroup. 
We consider the homogeneous space V = H\G and fix the identity 
coset xo = [e]. Let T be a discrete subgroup of G such that the orbit 
is discrete, and let {Bt : T > 1} be a family of compact subsets 
of V whose volume tends to infinity as T — > oo. Understanding the 
asymptotic of ^{xqY '(IB?) is a fundamental problem which bears many 
applications in number theory and geometry. 
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When T is a lattice in G, i.e., when T\G admits a finite invariant 
measure, this problem is well understood: assuming that the bound- 
aries of .Bt's are sufficiently regular and that H fl T is a lattice in H, 
#{xoT fl .&r) is asymptotically proportional to the volume of Bt, com- 
puted with respect to a suitably normalized G-invariant measure in 
V. 

When T is a thin group, i.e., a Zariski dense subgroup which is not 
a lattice in G, this type of counting problem is little understood in a 
general setting. In the present notes, we focus on the case when G 
is the special orthogonal group SO(n, 1) and H is either a symmetric 
subgroup or a horospherical subgroup (the case of H being the trivial 
subgroup will be treated as well). In this case, we have a more or less 
good understanding for the counting problem for groups V satisfying a 
certain finiteness property. 

By the fundamental observation of Duke, Rudnick and Sarnak |14j . 
the counting problem for x T fl B T can be well approached via the 
following equidistribution problem: 

Describe the asymptotic distribution ofT\THg in T\G as g — > oo. 

The assumption that H is either symmetric or horospherical is made 
so that we can approximate the translate T\THg locally by the matrix 
coefficient function in the quasi-regular representation space L 2 (T\G). 
This idea goes back to Margulis's thesis in 1970 [28] (also see [23J ) , 
but a more systematic formulation in our setting is due to Eskin and 
McMullen PJ. 

The fact that the trivial representation is contained in L 2 (r\G) for 
r lattice is directly related to the phenomenon that, when T\TH is 
of finite volume, the translate T\THg becomes equidistributed in T\G 
with respect to a G-invariant measure as g — > oo in H\G. When T 
is not a lattice, the minimal subrepresentation, that is, the subrepre- 
sentation with the slowest decay of matrix coefficients of L 2 (T\G), is 
infinite dimensional and this makes the distribution of T\THg much 
more intricate, and understanding it requires introducing several sin- 
gular measures in T\G. A key input is the work of Roblin [10] on the 
asymptotic of matrix coefficients for L 2 (T\G), which he proves using 
ergodic theoretic methods. 

There is a finer distinction among thin groups depending on the size 
of their critical exponents. When the critical exponent 6 of T is bigger 
than (n — l)/2, the work of Lax and Phillips [26], together with the 
classification of the unitary dual of G, implies that the minimal subrep- 
resentation of L 2 (T\G) is isolated; in other words, L 2 (T\G) possesses a 
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spectral gap property. Developing Harish-Chandra's work on harmonic 
analysis on G in combination with Roblin's work on ergodic theory, we 
obtain an effective version of the asymptotic of matrix coefficients for 
L 2 (T\G) in joint work with Mohammadi (31]. This enables us to state 
an effective equidistribution of T\THg in T\G. Similar to the condi- 
tion that T\TH is of finite volume in the case of V lattice, there is also 
certain restriction on the size of the orbit T\TH in order to deduce such 
an equidistribution. A precise condition is that the skinning measure 
of F\TH, introduced in [35], is finite. When the skinning measure, 
say /i^ s , is compactly supported, the passage from the asymptotic of 
the matrix coefficient to the equidistribution of T\THg can be done by 
the so-called usual thickening methods. However when fi^f is not com- 
pactly supported, this step requires a genuinely different strategy from 
the lattice case via the study of the transversal intersections, carefully 
done in [35J. 

The error term in our effective equidistribution result of T\THg de- 
pends only on the spectral gap of T. This enables us to state the 
asymptotic of ^{xoTd^y PI Bt) effectively in a uniform manner for all 
7 G T and for any family {T^ < T} of subgroups of finite index which 
has a uniform spectral gap. When T is a subgroup of an arithmetic 
subgroup of G, the work of Salehi-Golsefidy and Varju jH], extending 
an earlier work of Bourgain, Gamburd and Sarnak [6] , implies that the 
family {T^} of congruence subgroups of T is such a family. 

A recent development on an affine sieve [7] then tells us that such 
a uniform effective counting statement can be used to describe the 
distribution of almost prime vectors. 

One of the most beautiful applications of the study of thin orbital 
counting problem can be found in Apollonian circle packings. We will 
describe this application as well as its higher dimensional analogues. 
The ordering in counting circles can be done not only in the Euclidean 
metric, but also in general conformal metrics. It is due to this flexibility 
that we can also describe the asymptotic number of circles in the ideal 
triangle of the hyperbolic plane ordered by the hyperbolic area in the 
last section. 

Acknowledgment These notes are mostly based on the papers [35] 
and [31]. I am grateful to Nimish Shah and Amir Mohammadi for 
their collaborations. I would also like to thank Tim Austin for useful 
discussions concerning the last section of these notes. 
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2. T-INVARIANT CONFORMAL DENSITIES AND MEASURES ON T\G 

In the whole article, let (HP, d) be the n-dimensional real hyperbolic 
space with constant curvature —1 and <9(HP) its geometric boundary. 
Set G := Isom + (HP) ~ SO(n, 1)°. Let T be a discrete torsion-free 
subgroup of G. We assume that T is non-elementary, or equivalently, 
T has no abelian subgroup of finite index. 

We review some basic geometric and measure theoretic concepts for 
T and define several locally finite Borel measures (i.e., Radon measures) 
on F\G associated to T-invariant conformal densities on <9(HP). When 
T is a lattice, these measures all coincide with each other, being simply 
a G-invariant measure. But for a thin group T, they are all different and 
singular, and appear in our equidistribution and counting statements. 
General references for this section are [38], [10], [37], [15], [16], pfO] . 



2.1. Limit set and geometric finiteness. We denote by Sr = 5 the 
critical exponent of T, i.e., the abscissa of convergence of the Poincare 
series J2~,er e- sd(o ' 7(o)) for o e HP. We have < 8 < n - 1. The limit 
set A(r) is defined to be the set of all accumulation points of T(z) in 
the compactification IF = HP U d(M n ), z e M n . As T is discrete, A(r) 
is contained in the boundary <9(HP). 

Definition 2.1. (1) The convex core C(T) of T is the quotient by 
T of the smallest convex subset of HP containing all geodesies 
connecting points in A(r). 
(2) T is called geometrically finite (resp. convex cocompact) if the 
unit neighborhood of the convex core of T has finite volume 
(resp. compact). 

A lattice is clearly a geometrically finite group and so is a discrete 
group admitting a finite sided convex fundamental domain in HP. An 
important characterization of a geometrically finite group is given in 
terms of its limit set. For this, we need to define: a point £ G A(r) 
is called a parabolic limit point for r if £ is a unique fixed point of 
an element of T in HP and a radial limit point if the projection of 
a geodesic ray £ 4 toward £ in r\HP meets a compact subset for an 
unbounded sequence of time t. 

Now T is geometrically finite if and only if A(r) consists only of 
parabolic and radial limit points [10]. For V geometrically finite, its 
critical exponent 5 is equal to the Hausdorff dimension of A(r), and is 
n — 1 only when T is a lattice in G |45j . 
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2.2. Conformal densities. To define a conformal density, we first 
recall the Busemann function /3^(x,y) for x, y G HP and £ G <9(HP): 

Pfa,y) = lim d(z,f t ) 

t— »oo 

where £ t is a geodesic toward £. Hence (3^(x,y) measures a signed 
distance between horospheres based at £ passing through x and y (a 
horosphere based at £ is a Euclidean sphere in HP tangent at £). 

Definition 2.2. A T-invariant conformal density of dimension 5^ > is 
a family : x G HI™} of finite positive measures on <9(HP) satisfying: 

(1) For any 7 G T, 7*/z x = /i 7 ( x) ; 

( 2 ) fr(0 = ePrftb*) for all x,y £ HI™ and £ G d(JHP). 

It is easy to construct such a density of dimension n — 1, as we simply 
need to set m x to be the Stabc (^-invariant probability measure on HI™. 
This is a unique up to scaling, and does not depend on T. We call it 
the Lebesgue density. 

How about in other dimensions? A fundamental work of Patterson 
[37] . generalized by Sullivan [33], shows the following by an explicit 
construction: 

Theorem 2.3. There exists a Y -invariant conformal density of dimen- 
sion 5r = 5. 

Assuming that T is of divergence type, i.e., its Poincare series di- 
verges at s = 5, Patterson's construction can be summarized as fol- 
lows: Fixing o G HI™, for each x G HI™, consider the finite measure on 
HI™ given by 

Ux ' s = V p-sd{o a {o)) e Sd{x,j{o)) ^{o)- 
Z^ 76 r e 7er 

Then v x is the (unique) weak-limit of 6 + , and {y x : x G HI™} 

is the desired density of dimension 5. 

In the following, we fix a T- invariant conformal density {u x } of di- 
mension 5, and call it the Patterson-Sullivan density (or simply the PS 
density) . It is known to be unique up to scaling, when T is of divergence 
type, e.g., geometrically finite groups. 

Denoting by A the hyperbolic Laplacian on HI™, the PS density is 
closely related to the bottom of the spectrum of A for its action on 
smooth functions on r\HP. If we set 4>o(x) := \u x \ for each x G HI™, 
then 

Ms) = [ <M0 = / PiO <M0 = [ e**fc*W,(fl. 
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Since j*v x = ^ 7 ( x ), we note that (j)o(j(x)) = 4>o(x), i.e., O is a function 
on r\H n , which is positive everywhere! Furthermore we have 

(1) A(0 O ) = S(n - 1 - 5)0 O ; 

(2) if T is geometrically finite, then O £ L 2 (r\HP) if and only if 
<y>(n-l)/2. 

2.3. Measures on T\G associated to a pair of conformal den- 
sities. For v G T 1 (M n ), we denote by v + and v the forward and 
backward endpoints of the geodesic determined by v. Fixing o G HP, 
the map v h- > (v + ,v~,s = (3 v -(o,v)) gives a homeomorphism between 
T 1 (H ri ) and (<9(H n ) x <9(HP) - diagonal) x E. Therefore we may use 
the coordinates (v + , v~, s = (3 V - (o, v)) of v in order to define measures 
on T 1 (H n ). 

Let {fi x } and {fi x } be T-invariant conformal densities on <9(HP) of di- 
mensions 5^ and 8^ respectively. After Roblin [40J , we define a measure 
m v,v on T X (X) associated to {fi x } and by 

dm"'"' {v) = e 5 ^ +M eV^-M dfi {v + )dfi' {v-)ds. (2.4) 

It follows from the T-invariant conformal properties of {fi x } and {fx' x } 
that the definition of m M,M is independent of the choice of o G HP and 
that m ti,fl is left T-invariant. Hence it induces a Radon measure m M,M 
on the quotient space T 1 (r\H"') = r\T x (H n ). 

We will lift the measure m"'" to T\G. This lift depends on the choice 
of subgroups K, M and A = {a t } of G. Here K is a maximal compact 
subgroup of G and M is the stabilizer of a vector X G T 1 (HI n ) based 
at o G HP with K = G D . Via the isometric action of G, we may identify 
the quotient spaces G/K and G/M with HP and T^HP) respectively. 
Let A = {a t } be the one parameter subgroup of diagonalizable elements 
of G such that the right multiplication by at on G/M corresponds to 
the geodesic flow on T 1 (HI n ) for time t. 

By abuse of notation, we use the same notation m"'" for the M- 
invariant extension of m"'"' on T\G/M = r\T 1 (H n ) to T\G, that is, 
for * e C C (T\G), 

m *"'(tf) = j m M {x)dm^\x) 

where ty M (x) = f M ty(xm)dm for the probability M-invariant measure 
dm on M. 

The measures m M ' M on T\G where fi and fi' are the PS-density {y x } 
or the Lebesgue density {m x } are of special importance. We name 
them as follows: 
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Bowen-Margulis-Sullivan measure: m BMS 
Burger-Roblin measure: m BR := m m ' v ] 
Burger-Roblin *-measure: m BR := m^ ,r " 
Haar measure: m Haar := m 



m.m 



For brevity, we refer to these as BMS, BR, BR*, Haar measures 
respectively. As the naming indicates, m Haar turns out to be a G- 
invariant measure. For g G G, we use the notation g for (gM)^ 1 with 
gM considered as a vector in T 1 (H n ). It is clear from the definition 
that the supports of BMS, BR, BR* measures are respectively given 
by {g G T\G : g ± G A(r)}, {g G T\G : g~ G A(r)}, and {g G T\G : 
g + G A(r)}. In particular, the support of BMS measure is contained 
in the convex core of V. Sullivan showed that |m BMS | < oo if V is 
geometrically finite. 

The BMS, BR and BR* measures are respectively invariant under 
A, N + and N~~ where (resp A^~) denotes the expanding (resp. 
contracting) horospherical subgroup of G for a t : 

N = {g G G : a t ga_ t ->east-> ±00}. 

The finiteness of m BMS turns out to be a critical condition for the 
ergodic theory on T\G. 

Theorem 2.5. Suppose that |m BMS | < 00 and that T is Zariski dense. 
(1) m BMS is A-mixing: for any ^1,^2 £ L 2 (T\G), 

lim / M9at)M9) dm BMS (g) = t^^™ BMS (*i) • m BMS ^ 2 ). 



(2) m BR is the unique N + -invariant ergodic measure on T\G which 
is not supported on a closed N + -orbit. 

(3) m BR is a finite measure if and only if T is a lattice in G 

The claim (1) is due to Flaminio and Spatzier [17]. For M-invariant 
functions, this was earlier proved by Babillot [1J and in this case the 
Zariski density assumption is not needed. (3) is proved in [35] , us- 
ing Ratner's measure classification of finite measures invariant under 
unipotent flows |39j. Namely, we show that m BR is not one of those 
homogeneous measures that her classification theorem lists for finite 
invariant measures. The claim (2) is a far reaching generalization by 
Roblin [ID] of an earlier theorem of Burger [11] in the case of a convex 
co compact surface. 

In the spirit of Ratner's measure classification theorem [3H], we pose 
the following question: 
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Problem 2.6. Under the assumption of Theorem 2J)_, let U be a con- 
nected unipotent subgroup of G or more generally a connected subgroup 
generated by unipotent one-parameter subgroups. 

(1) Classify all locally finite U -invariant ergodic measures in T\G. 

(2) Describe the closures of U -orbits in Y\G. 

The emphasis here is that we want to understand not only finite 
measures but all Radon measures. This seems to be a very challenging 
question. We mention a recent related result of (30]: if V is a convex 
cocompact subgroup of G and U is a connected unipotent subgroup of 
N + of dimension k, m BR is [/-ergodic if 8 > (n — 1) — k. 



3. Matrix coefficients for L 2 (r\G) 

Let K be a maximal compact subgroup of G and fix a Cartan de- 
composition G = KA + K. We parametrize A + = {a t : t > 0} so 
that at corresponds to the geodesic flow on T 1 (EI T1 ) = G/M where 
M := C K (A+). 

Denote by G the unitary dual, i.e., the set of equivalence classes of 
all irreducible unitary representations of G. A representation 7r e G is 
said to be tempered if for any f^-finite vectors vi,v 2 of tt, the matrix 
coefficient function g !->■ (7r(g)t>i, t> 2 ) belongs to L 2+e {G) for any e > 0. 
We write G = G temp U G non _ t emp as the disjoint union of tempered 
representations and non-tempered representations. 

The well-known classification of the unitary dual G says that G n on-temp 
consists of the trivial representation and the complementary series rep- 
resentations [25] . By choosing a Casimir operator C of the Lie algebra 
of G normalized so that it acts on C oc (G) K = C°°(EI n ) by the negative 
Laplacian, we can parametrize the complementary series representa- 
tions as {H s : s G ((n — l)/2, (n — 1))} where C acts on Hf by the 
scalar s(s — n + 1). 

Let T be a discrete, torsion-free, non-elementary subgroup of G. The 
right translation action of G on L 2 (r\G, m Haar ) gives rise to a unitary 
representation, as m Haar is G-invariant. For ^1,^/2 £ L 2 (T\G), the 
matrix coefficient function is a smooth function on G defined by 

#2) := / ^i(x#)# 2 (x)dm Haar (x). 
Jr\c 

Understanding the asymptotic expansion of (a t .^i, ^f 2 ) ( as t — > 00) 
is a basic problem in harmonic analysis as well as a main tool in our 
approach to the counting problem. 



COUNTING 



9 



The quality of the error term in this type of the asymptotic expansion 
usually depends on Sobolev norms of \l/j's. For * G C°°(r\G) and 
d G N, the d-th Sobolev norm of * is given by S d (^>) = \\X(^)\\ 2 
where the sum is taken over all monomials X in some fixed basis of the 
Lie algebra of G of order at most d and ||X(\I/)||2 denotes the L 2 -norm 
of*. 

3.1. Lattice case: |m Haar | < oo. Set 

L 2 (T\G) : = {* G L 2 (r\G) : / * dm Haar = 0}. 

When T is a lattice, we have L 2 (T\G) = C®L 2 (T\G). It is well-known 
that there exists (n — l)/2 < s < {n — 1) such that Lq(T\G) does 
not contain any complementary series representation % s of parameter 
s > Sq [3|. This implies the following (cf. [24, Prop 5.3]): 

Theorem 3.1. Suppose T is a lattice in G, that is, |m Haar | < oo. There 
exists £ G N such that for any * 2 <E L 2 (T\G) n C(T\G)°°, we have, 
as t — )■ oo, 

where m Haar (*j) = J r ^$j(a;)cfm Haar (x) for i — 1,2. 

We note that the constant function l/y / '|m Haar | is a unit vector in 
L 2 (r\G) and the main term |^H^m Haar (\l/i)m Haar (\l/2) is simply the 
product of the projections of *i and \l/ 2 to the minimal subrepresen- 
tation space, which is C, of L 2 (T\G). 

3.2. Discrete groups with |m BMS | < 00. When T is not a lattice, 
we have L 2 (T\G) = Lq(T\G). By the well-known decay of the matrix 
coefficients of unitary representations with no G-invariant vectors due 
to Howe and Moore [21], we have, for any * 2 e L 2 (r\G), 

Hm(a t .*i,* 2 ) = 0. 

t— ¥00 

However we have a much more precise description on the decay of 
(ot-^i, *a) due to Roblin: 

Theorem 3.2. [40] Let T be Zariski dense with |m BMS | < 00. For any 

*i,* 2 eC c (r\G), 

t^oo \m BMb \ 
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Roblin proved this theorem for M-invariant functions using the mix- 
ing of the geodesic flow due to Babillot [1] . His proof extends without 
difficulty to general functions, based on the A-mixing in T\G stated as 
in Theorem 12.51 

3.3. Geometrically finite groups with 5 > (n — l)/2. In this sub- 
section, we assume that T is a geometrically finite group with 5 > 
(n — l)/2. This assumption is needed for the existence of a spectral gap 
for L 2 (r\G). Together with the aforementioned fact about G n on-temp, 
the works of Lax and Phillips [2S] and of Sullivan [37] imply: 

Theorem 3.3. There exist (n — l)/2 < < Sk-i < ■ ■ ■ < si < so < 
(n — 1) such that 

l 2 (t\g) = n so ® ■ ■ ■ ®n Sk ®w 

where W consists of tempered representations. Moreover 5 = Sq(u — 
l-«o). 

Note that the minimal representation 1-L SQ is of multiplicity one in 
L 2 (T\G). The difference s± — sq > is called the spectral gap for F. 



Theorem 3.3 implies that for ^i,^ 2 G L 2 (T\G), the leading term of 
the asymptotic expansion of the matrix coefficient (at-^i, ^2) is de- 
termined by (a t .P SQ (^i), P SQ (^/ 2 )) where P so is the projection operator 
from L 2 {T\G) toU S0 . 

Building up on the work of Harish- Chandra on the asymptotic behav- 
ior of the Eisenstein integrals (cf. [32], [SD]), we obtain an asymptotic 
formula for (a t v,w) for all ^-isotypic vectors v, w 6 H So - This exten- 
sion alone does not quite explain the leading term of (a t P So (^ 1) , P So (^2)) 
in terms of functions and ^ 2 ; however, with the help of Theorem 
3.2 , we are able to prove the following: 

Theorem 3.4. |JT] There exist r] > (depending only on the spectral 
gap for T) and £ e N such that for any ^1, ^/ 2 £ C^°(T\G), as t — > oo ; 



We reiterate that the leading term in Theorem 3.4 is from the ergodic 
theory and the error term is from the harmonic analysis and the spectral 
gap. 



3.4. Effective mixing for m BMS . Theorem 3.4 can be used to obtain 



an effective mixing for the BMS measure (i.e., an effective version of 



Theorem 2.5^1)) for geometrically finite groups with 5 > (n — 1)/2 [31j . 

For geometrically finite groups with 5 < (n — l)/2, Lax-Phillips 
showed that the L 2 -spectrum of the Laplacian is continuous [2S] and 
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hence we cannot expect Theorem 3.4 to hold for such groups. However 



a recent work of Guillarmou and Mazzeo [20] establishes meromorphic 
extensions of the resolvents of the Laplacian and of the Poincare series. 

For T convex cocompact, Stoyanov obtained, via the spectral prop- 
erties of Ruelle transfer operators, an effective mixing of the geodesic 
flow for the BMS measure, regardless of the size of the critical exponent 
(see [37]). We remark that the idea of using spectral estimates of Ru- 
elle transfer operators in obtaining an effective mixing was originated 
in Dolgopyat's work [T5] . 

It will be interesting to see if the results in [20] can be used to answer 
the question: 

Problem 3.5. Prove an effective mixing of the geodesic flow for the 
BMS measure for all geometrically finite groups. 



We close this section by posing the following: 



Problem 3.6. Find a suitable analogue of Theorem 3.4 for a higher 
rank simple Lie group G such as SL 2 (IR) x SL 2 (IR) or SL 3 (IR). 



4. Distribution of T in G 



For a family of compact subsets in G which is getting larger and 
larger as T — > oo, the study of the asymptotic of #(m B T ) can be 
approached directly by Theorems 3.2 and 3.4 The link is given by the 
following function on r\G x T\G: 



F T (g,h) :=^2xb t (9 1 lh). 

7er 



Observing that F T (e, e) = #(TnB T ), we will explain how the asymp- 
totic behavior of -Pr(e, e) is related to the matrix coefficient function for 
L 2 (r\G). For g = k x a t k 2 e KA + K, we have dm Haar (#) = ^{t)dtdk t dk 2 
where f (t) = e^ -1 ^! + 0{e-^)) for some > 0. 



Now assume that T is geometrically finite with 5 > (n — l)/2, so that 
Theorem 3.4 holds. For any real- valued ^1,^2 C%°(T\G), if we set 
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^i(g) '■= ^i(gk), then we can deduce from Theorem 3.4 that 
(F T , <g> ^ 2 )r\Gxr\G 
= / (^i,^.^ 2 ) L 2 (r \ G) rfm Haar (^) 

= / (^i 1_1 ,a t .*2 2 > • ^(t)dtdk!dk2 

J kiatk2&Bx 
1 



| m BMS| 



m^i 1 )m BR (^^ 2 )e 5i + ©(e^*) ) dtdk x dk 2 

kiatk2GBT 

(4.1) 



for some rj > 0, with the implied constant depending only on Sobolev 
norms of \I/j's. 

Therefore, if Fr(e, e) can be effectively approximated by (Ft, \t / fE ®\I / (E ) 
for an approximation of identity \I/ e in T\G, a condition which depends 
on the regularity of the boundary of Bt relative to the Patterson- 
Sullivan density, then Fr(e, e) can be computed by evaluating the in- 
tegral (4.1) for = \1>2 = and by taking e to be a suitable power 
of e _t . 

To state our counting theorem more precisely: 

Definition 4.2. Define a Borel measure M.q on G as follows: for 

ijj e C C (G), 



M G (tp) = t^tjmst / ip(kia t k 2 )e 5t dv (k l )dtdv (k 2 x ) 

Jk ia tk2eKA+K 



here v a is the M -invariant lift to K of the PS measure on d(M. n ) = 
K/M viewed from o G HP with K = Stabc(o). 

Definition 4.3. For a family {B^ C G} of compact subsets with 
A4g(B t ) tending to infinity as T — > oo, we say that {B T } is effectively 
well-rounded with respect to T if there exists p > such that for all 
small e > and T ^> 1: 

M G {B+ e - B~ e ) = 0(e p ■ M G (B T )) 

where = G e BxG e and B^ € = n 9li92e G E 5'i-Brfi , 2- Here G t denotes a 
symmetric e-neighborhood of e in G. 

Theorem 4.4. [31] // {Bt} is effectively well-rounded with respect to 
T, then there exists r] > such that for any subgroup V < T of finite 
index and for any 7 G T, 

#(F 7 n B T ) = ^^M G (B T ) + 0(M G (B T y-^) 
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where tjq > depends only on a uniform spectral gap for F and V , and 
the implied constant is independent ofT' and 7. 

For instance, consider the set B? = f^Apf^ where f2j C K and 
A T = {a t : < t < T}. If there exists 0' > such that the PS- 
measures of the e-neighborhoods of f2i and 1 are at most of order 
e@ for all small e > 0, then Bt is effectively well-rounded and hence 
one can deduce the following: 

Theorem 4.5. [3XJ As T oo ; 

#(r' 7 n fWfc) = ^^e ST + o(e^ T ) 

where H(r, fii, f^) := U °^^bms 2 \ - and the implied constant is indepen- 
dent ofV and 7 G V . 

The fact that the only dependence of V on the right hand side of 
the above formula is on the index [r : V] is of crucial importance 



for our intended applications to an affine sieve (cf. subsection 6.6) 



Bourgain, Kontorovich and Sarnak [8] showed Theorem |4. 5 for the case 
G = SO (2, 1) via an explicit computation of matrix coefficients using 
the Gauss hypergeometric functions, and Vinogradov [IB] generalized 



the non-effective version of Theorem 4.5 holds for any Zariski dense 
T with |m BMS | < 00; this was obtained in [40] (see also |35j ) with a 



their method to G = SO(3, 1). We note that in view of Theorem 3.2 
the non-effectr 
r with |m BMS | 
different proof. 



5. Asymptotic distribution of T\THa t 

The counting problem in H\G for H a non-trivial group can be ap- 
proached via studying the asymptotic distribution of translates T\THa t 
as mentioned in the introduction. We will assume in this section that 
H is either a symmetric subgroup or a horospherical subgroup of G. 
In this case, we can relate the distribution of r\THa t to the matrix 
coefficient function of L 2 (T\G). 

We fix a generalized Cartan decomposition G = HAK (for H horo- 
spherical, it is just an Iwasawa decomposition) where K is a maximal 
compact subgroup and A is a one-dimensional subgroup of diagonal- 
izable elements. As before, we parametrize A = {a t : t 6 M.} so that 
the right multiplication by at on G/M = T 1 (H n ) corresponds to the 
geodesic flow for time t. 

When H is horospherical, we will assume that H = N + , i.e, the 
expanding horospherical subgroup with respect to a t . 
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For a symmetric subgroup if, isomorphic to SO(k, 1) x SO(n — k) for 
< k < n — 1, an if -or bit in G/K (resp. G/M) is (resp. the normal 
bundle to) a complete totally geodesic subspace of HP of dimension k. 
The right multiplication by at on G/M corresponds to the geodesic flow 
and the image of Ha t in G/M represents the expansion of the totally 
geodesic subspace of dimension k by distance t. 

5.1. Measures on T\TH associated to a conformal density. The 

leading term in the description of the asymptotic distribution of r\THa t 
turns out to be a new measure on T\TH associated to the PS density 
(see [35J). We assume that T\TH is closed in T\G in the rest of this 
section. 

For a T-invariant conformal density {/J, x } on <9(HP) of dimension 5^, 
define a measure fin on if / (H fl M) by 

djl H {[h\) = eWw+M 1 ® dfi ([h] + ) 

where o G HP and [h] G H/H fl M is considered as an element of 
G/M = T^HP) under the injective map H/(H fl M) — >■ G/M. 

By abuse of notation, we use the same notation fin for the if n M- 
invariant lift of fin to if: for ip G C c (r\G), 

AtH(^) = / i{> HnM (x)dfi H (x) 

J H/(HnM) 

where ip HnM (x) = f HnM ip( y xm)dHnM{'m) for the H PlM-invariant prob- 
ability measure dnnM- This definition is independent of the choice of 
o G HP and the measure fiu is H fl T-invariant from the left, and hence 
induces a measure fin on (if fl T)\ff or equivalently on T\rff . 

For the PS density and the Lebesgue density {m x }, the follow- 
ing two locally finite measures on r\rif are of special importance: 

• Skinning measure: fifp = Vh] 

• ff-invariant measure: /^f b = tuh- 

We remark that fi^f is different from fj^ h in general even when if D T 
is a lattice in ff . 

5.2. Finiteness of /^ s . The finiteness of the skinning measure /x^ s 
turns out to be the precise replacement for the finiteness of the volume 
measure /x^f b , in extending the equidistribution statement from the 
cases of T lattices to those of thin groups. 

When is the skinning measure /i^ s finite? This question is com- 
pletely answered in |35j for T geometrically finite. First, when if is a 
horospherical subgroup, the support of /i^ s is compact. When if is a 
symmetric subgroup, i.e., isomorphic to SO(fc, 1) x SO(n — k) locally, 



COUNTING 15 

the answer to this question depends on the notion of the parabolic co- 
rank of T fl H: let A p (r) denote the set of all parabolic limit points of 
T. For £ G A p (r), the stabilizer has a free abelian subgroup of finite 
index, whose rank is defined to be the rank of T^. 

Definition 5.1. The parabolic corank of V fl H in V is defined to 
be the maximum of the difference rank(r^) — rank(r fl H)^ over all 

£ g A p (r) n d(M k ). 

Theorem 5.2. |35] Let F be geometrically finite. 

(1) /i# s is compactly supported if and only if the parabolic corank of 
r fl H is zero. 

(2) |//# s | < oo if and only if 5 is bigger than the parabolic corank of 
THH. 

As we showrank(r 5 )-rank(rrW) ? < n-k for all £ G A p (r)n<9(EI fc ), 
we have: 

Corollary 5.3. [35J If 5 > {n-k), then |/i^ s | < oo. 
5.3. Distribution of T\THa t . We first recall: 

Theorem 5.4. Suppose that V is a lattice in G and that H D T is a 
lattice in H. In other words, |m Haar | < oo and \m]f h \ < oo. Then there 
exist rjo > ( depending only on the spectral gap for T ) and i G N such 
that for any V G C c °°(r\G), as t -»■ oo ; 



*{ha t )d^\h) = f%^_ • m Haar (v|/) + 0(S t (V) ■ e'^) 



The non-effective statement is due to [TJ] (also see [IS])- For the 
effective statement, see [H] for the case when HnT\H is compact and 
[2] in general. 



An analogue of Theorem |5.4| for discrete groups which are not nec- 
essarily lattices is given as follows: 

Theorem 5.5. [35] Let V be Zariski dense with |m BMS | < oo. Suppose 
\fj^\ < oo. Then for any * G C c (r\G), 

r I ps i 

lim e^" 1 -^ / *{ha t )d^\h) = ^§^m^). 
t^oo J he r\rH \m BMb \ 

Theorem 5.6. [31J Let T be geometrically finite with 5 > (n — l)/2. 
Suppose |/i^ s | < oo. Then there exist r) > and f G N such that for 
any * G C™(T\G), as t -> oo ; 

r i PS i 

e (n ^- S)t I V(ha t )d^ H eh (h) = ^LL m BR (v]/) + 0(S e (V) ■ e"**). 



her\r# 
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In the case when p^f is compactly supported, we can show that there 
exists a compact subset Oh (depending on \1>) of T\TH such that for 
any t G E, V(ha t ) = for all h <£ O h . Therefore / *(/ia t )d# = 
f a ^{ha t )d^ h . Now the assumption on H being either symmetric 
or horospherical ensures the wave front property of [IE] which can be 
used to establish, as t — > oo, 

/ m(ha t )du^ h « (a t ^,po H ,e)^(r\G) 

J O h 

where po H ,e & C^°(T\G) is an e-approximation of Oh- Therefore the 
estimates on the matrix coefficients in Theorems 13.21 and 13.41 can be 



used to establish Theorems 15.51 and 15.61 

The case when p^f is not compactly supported turns out to be much 
more intricate, the main reason being that we are taking the integral 
with respect to p^f 3 as well as multiplying the weight factor e( n - 1 - s ) t 



in the left hand side of Theorem 5.5 whereas the fmiteness assumption 
is made on the skinning measure p^f. In this case, the proofs are 
done by comparing the two measures (a t )*p H s and (a t )*p H 2h via the 
the transversal intersections of the orbits T\THat with the weak-stable 
horospherical foliations . A key reason that this approach works is that 
these transversal intersections are governed by the topological property 
of the orbit T\THa t , independent of the measures put on T\FH. 

In the special case of n = 2, 3 and H horospherical, Theorem 5.6 was 
proved in [27] by a different method. 

6. Distribution of r orbits in H\G and Affine sieve 

6.1. Distribution of T orbits in H\G. Let H be as in the previous 
section (i.e., symmetric or horospherical subgroup) and let {Bt} be a 
family of compact subsets in H\G which is getting larger and larger 
as T — > oo. We assume that [e]T is discrete in H\G. The study of the 



asymptotic of #([e]T fl B T ) can be now approached by Theorems 5.5 



and 5.6 via the following counting function on T\G: 

F T(g) ■= Yl XB T (ig) 

7eHnr\r 

as -Fr(e) = #([e]r (1 Bt). Depending on the subgroup H, we have 
G = HA + K or G = HA + K U HA~K. For the sake of simplicity, we 
will consider the sets Bt contained in HA + K. We have for g = ha t k, 
dm Haar (#) = p (t)dp heh (h)dtdk where p(t) = e( n_1 )*(l + 0{e~ pt )) for 
some /3 > 0. Let p be a G-invariant measure on H\G normalized so 
that c?m Haar = <i/i^ ob <g> dp locally. Then, under the assumption that T 
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is geometrically finite with 8 > (n — l)/2 and |/4^ s | < oo, we deduce 
from Theorem 15.61 



(F T ,¥) = / / *{hg)d f j% b (h)dii(jg) 

lgeB T JheF\TH 

y k {ha t )dn L H cb {h)p{t)dtdk 

e]a t k£B T J heT\TH 

= I (MLm BR ^f k )e St + 0^-^)) dtdk (6.1) 

J[e]a t k£B T V ' 1 J 

for some r] > 0. 

Therefore, similarly to the discussion in section |4j if -Fr(e) can be 
effectively approximated by {Ft, for an approximation of identity 
\l/ e in a condition which depends on the regularity of the bound- 
ary of B T relative to the PS density then F T (e) can be computed by 
evaluating the integral (6.1) for = ty 6 and by taking e a suitable 
power of e~*. 

For H horospherical or symmetric, we have G = HA + K or G = 
HA + K U HA~K (as a disjoint union except for the identity element) 
where A ± = {a± t : t > 0}. 

Definition 6.2. Define a Borel measure M.r\g on H\G as follows: for 

V> e C C (H\G), 

MhgW = J^ s ^^ + ^ V;([e]a ' A;)e ^ I/o( ^ 1) XG = HA+K 

L ±t fce J 4±A-^([ e ] a ±< /i; ) e ' 5t ^ z/ o( fc ~ 1 ) otherwise, 

where o G HP is the point fixed by K, v a is the right M-invariant 
measure on K, which projects to the PS-measure v a on K/M = d(M") 
and /i^ s _ is the skinning measure on T(lH\H in the negative direction. 

Definition 6.3. For a family {Bt C B\G} of compact subsets with 
Mh\g(Bt) tending to infinity as T — > oo, we say that {Bt} is effec- 
tively well-rounded with respect to T if there exists p > such that for 
all small e > and T ^> 1: 

M H \ G (B+ e - B Te ) = 0(e p ■ M h \g{B t )) 
where B^ t = BtG £ and B^ e = n g£ G c BTg. 

Theorem 6.4. |31j When H is symmetric, we assume that |/x^ s | < oo. 
Suppose that {Bt} is effectively well-rounded with respect to T. Then 
for any subgroup V < T of finite index such that HC\T = HnV and for 
any 7 G T, there exists r] > (depending only on a uniform spectral 



18 



HEE OH 



gap of r and V) such that 

#([e]r' T o n Br) = p^jMaxoCBr) + 0(^h\g(Bt) 1 " ,w ) 

wit/i t/ie implied constant independent ofV and 7 G T. 

For a given family {Br}, understanding its effective well-roundedness 
may be the hardest part of the work in general. We consider an example 
of the family {B T = [e]A T Q} where Q C K and A T = {a t . <t < T}. 
In this case, it is rather simple to formulate the effective well-rounded 
condition: there exists /3' > such that the PS-measure of the e- 
neighborhood of <9(f2 _1 ) is at most of order for all small e > 0. Of 
course, this holds when Q = K or when d(Vt~ l ) does not intersect the 
limit set A(r). 



Then, setting H(r, O) := ^fi^BMSi ~ , one can deduce from (6.1) 



<5-|m BMS | 

Theorem 6.5. [31J Under the same assumption on and V , there 
exists T] Q > ( depending only on a uniform spectral gap of Y and V) 
such that for any 7 G T, 

#([e]r' 7 n [e)A T U) = |^e^ + O(e^) 

with implied constant independent ofV and 7. 



We note that in view of Theorem |4. 1 , the non-effective version of this 
theorem holds for any Zariski dense Y with |m BMS | < 00 and |/4/ S | < 00, 
as proved in [35] . 

6.2. AfRne sieve. For applications to an affine sieve, we consider the 
case when the homogeneous space H\G is defined over Z. More pre- 
cisely, we assume that G is defined over Z and acts linearly and irre- 
ducibly on a finite dimensional vector space W defined over Z in such 
a way that G(Z) preserves V(Z). Let wo G W(Z) be a non-zero vector 
such the stabilizer of wq is a symmetric subgroup or the stabilizer of 
the line M.w is a parabolic subgroup. We set V := w G. Let T be a 
geometrically finite subgroup with 5 > (n — l)/2, which is contained in 
G(Z). 

Let F be an integer-valued polynomial on the orbit WqT. Salehi- 
Golsefidy and Sarnak [12], generalizing [6j, showed that for some R > 1, 
the set of x G WqT with F(x) has at most R prime factors is Zariski 
dense in wqG. 

For a square-free integer d, let < T be a subgroup which contains 
{7 G T : 7 = e mod d} and satisfies Stabr d (wo) — Stabr(wo)- Salehi- 
Golsefidy and Varju [H], generalizing jH], showed that the family of 
Cayley graphs of r/T d 's (with respect to the projections of a fixed 
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generating set for T) forms expanders as d runs through square-free 
integers with large prime factors. As 5 > (n — l)/2, this implies that 
the family {Td : d square- free} has a uniform spectral gap, as shown 



in [7j (see also [22J). Hence we can apply Theorem 6.5 to IYs. By 
a recent development on an affine linear sieve on homogeneous spaces 
([6], [32]), we are able to deduce: let F be an integer- valued polynomial 
on WqT which is weakly primitive, i.e., gcd{F(x) : x G WqT} is 1. 
Letting F = FiF 2 ■ ■ ■ F r be a factorization into irreducible polynomials, 
assume that all F^s are integral on WoT. Let A be the log of the largest 
eigenvalue of a\ on the IR-span of wqG. 

Theorem 6.6. [3T] For any norm || ■ || on V, 

(1) {x G WoT : ||x|| < T, Fj(x) is prime for j = 1, •• • , r} <C 

rpS/X 

QogT)r'l 

(2) there exists R = R(F, WqT) > 1 such that 

rp8/X 

{x G WqT : ||x|| < T, .F(x) /ias at most R prime factors} 



(io g iy 

In view of the above discussion, it is also possible to state Theorem 



6.6 for more general sets E>t, instead of the norm balls. 



7. Application to sphere packings 

In this section we will discuss counting problems for sphere packings 
in MJ 1 as an application of an orbital counting problem for thin groups 
of SO(n, 1). By a sphere packing in the Euclidean space M. n for n > 1, 
we simply mean a union of (possibly intersecting) n — 1-dimensional 
spheres; here an n — 1 dimensional plane is regarded as a sphere of 
infinite radius. 

Fixing a sphere packing V in MP, a basic problem is to understand the 
asymptotic of the number #{S G V : Radius(S') > t} or equivalently 
#{£ G V : Vol(S') > t} where Vol(S') means the volume of the ball 
enclosed by S. For the sake of brevity, we will simply refer Vol(S') 
to the volume of S. We will consider this problem in a more general 
setting, that is, allowing the volume of the sphere S to be computed in 
various conformal metrics. 

Let U be an open subset of lR n and / a positive continuous function 
on U. A conformal metric associated to the pair (U, f) is a metric on 
U of the form f(x)dx where dx is the Euclidean metric on M. n . Given a 
conformal metric (U, f), we set Vol/ (S) := J B f(x) n dx where B is the 
ball enclosed by S. When S is a plane, we put Vol/ (S) = oo. 
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For any compact subset E of U and t > 0, set 

N t (V, f, E) := Vo\ f (S) >t, ECiS^dS}. 

For simplicity, we will oftentimes omit V in the notation N t (V,f,E). 
When (U, f) = (M. n , 1), i.e., the standard Euclidean metric, we simply 
write N t (E) instead of N t (l,E). We call V locally finite if N t (E) < oo 
for all E bounded. 

In order to approach the problem on the computation of the asymp- 
totic of N t (f,E), a crucial condition is that V admits enough sym- 
metries of Mobius transformations of W 1 . By the Poincare extension, 
the group MG(lR n ) of Mobius transformations of lR n can be identified 
with the isometry group of the upper half space HP +1 = {(z,r) : z G 
M n ,r > 0}. We assume that V is invariant under a non-elementary 
discrete subgroup r of G := Isom + (H n+1 ). As before, let S denote the 
critical exponent of T and \v x : x G a Patterson-Sullivan density 

for r. 

We recall from [36J: 

Definition 7.1 (The T-skinning size of V). For a sphere packing V 
invariant under T, define < skr('P) < oo as follows: 

sk r (P) := V / e^ +(0 ' s) rfz/ (s + ) 

where o G H n+1 , {Si : i G 1} is a set of representatives of T-orbits in 
V, and Sj C T 1 (H n+1 ) is the set of unit normal vectors to the convex 
hull of Si. 

Definition 7.2. For the pair (U, f), we define a Borel measure u-pj on 
U: for V G C C (U) and for o G H n+1 , 

corjW = I Tp(z)f(z) 5 e s ^°^ dv a {z). 

Alternatively, we have a simple formula: 

du rj = f(z) 5 (\z\ 2 + l) s du en+1 
where e n+1 = (0, ■ ■ ■ , 0, 1) G H n+1 . 

Example 7.3. (1) For the spherical metric (M n , ) (also called 
the chordal metric) on IR n , Vol/(S') is the spherical volume of 
the ball enclosed by 5 and durj = 2 s ■ dv en+1 . 
(2) For the hyperbolic metric (H n = {z G R n : z n > 0}, i), Vol f (S) 
is the hyperbolic volume of the ball enclosed by S and dur / = 

z 5 Ui/ e„ + i • 
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Definition 7.4. By an infinite bouquet of tangent spheres glued at a 
point £ G IR n U{oo}, we mean a union of two collections, each consisting 
of infinitely many pairwise internally tangent spheres with the common 
tangent point £ and their radii tending to 0, such that the spheres in 
each collection are externally tangent to the spheres in the other at £. 

We set v n := Vol(S(0, 1)) to be the Euclidean volume of the unit 

ball .8(0, 1) := {x G E n : ||a;|| < 1}; v n is equal to ^l-n ^ n * s even 

and - /„ if n is odd. 

l-3---n 

Theorem 7.5. Let V be a locally finite sphere packing invariant under 
a geometrically finite group V with finitely many T-orbits. In the case 
of 5 < 1, we also assume that V has no infinite bouquet of spheres glued 
at a parabolic fixed point ofT. 

Then for any conformal metric (U, /) and for any compact subset E 
of U whose boundary has zero Patters on- Sullivan density, as t — > 0, 

hmN t (f,E)t< Hm BMS| • 

The assumption on the non-existence of an infinite bouquet in V is 
to ensure that the T-skinning size for V is finite. 



In the case when (U, f) = (M. n ,l), Theorem 7.5 was proved in [36J 
for the case of n = 2 and and the proof given there extends easily for 
any n > 2 using the general equidistribution result in |35j. To give an 



interpretation of Theorem 7.5| as a special case of the orbital counting 



problem discussed in the subsection 6T, fixing H to be the stabilizer 
of a sphere So in V, we may think of H\G as the space of all totally 
geodesic planes in EI n+1 . Then a key point is to describe a particular 
subset B t (E) in H\G such that N t (E) is same as #[e]m B t (E). 

The extension to a general conformal metric (U, /) is possible basi- 
cally due to the uniform continuity of / on a compact subset E and 
a covering argument. We give a brief sketch as follows (the argument 
below is established in a discussion with Shah): denote by Q z {rj) the 
cube {z' G M. n : maxi<j<„ \z{ — z[\ < r/} centered at z G W 1 with radius 
V- 



First, Theorem 7.5 for / = 1, together with the uniform continuity of 
/ on E, implies that for any e > 0, there exists rj = 77(e) > (depending 
only on E and /) such that for any cube Q z (r)) centered at z G E 

N t (f,QM)t S/n n , n( ^ sk r QP) s 

jj- n = (1 + 0(e)) f(z) u r (Q z ( V ))- (7-6) 

Vn I I 

Let k be the minimal integer such that a fc-dimensional sphere, say, 
P charges a positive PS density. As the PS density is atom-free, we 
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have k > and the limit set A(T) is contained in P (see [lOj Prop. 
3.1]). We cover E fl P with cubes {Q z (ji) '■ z ^7} with disjoint 
interiors for a finite subset I v of E n P . As each cube is centered at a 
point of P which is a sphere, the intersection of its boundary with P is 
contained in a (k — l)-dimensional sphere for all small 77 > 0. It follows 
that the boundary of each cube has zero PS density by the minimality 
assumption on k. Let C{rf) := {Qzijf) '■ z e ^7} be a covering of 
with I v D J,,. Note that the boundary of each cube in C(rj) has zero 
PS density. We can find compact subsets Ef of U with E~ C E C E+ 
and a positive integer m e so that urj(E+ — E~) < e and Ef (resp. 
£7) contains all cubes centered at E (resp. E~) and of size less than r\ 
possibly except at most m e number of such cubes. 

We may also assume that f(z) = (1 + 0(e))f(z') for all z' G Q z (v) £ 
£(77) where the implied constant is uniform for all z G E. We may now 



apply Theorem 7.6 for / = 1 to each cube in the covering of C{rf) to 
obtain that 



:i + 0(e)) ^T^" rj( ^ +) + 0(e) 
:i + 0(e)) ^^^ (E) + 0(e) - 



As e > is arbitrary, this proves Theorem 7.5 



8. On Apollonian circle packings 
8.1. Construction. In the case of Apollonian circle packings in the 



plane M 2 = C, Theorem 7J3 can be made more explicit as the measure 
Co>r,/ turns out to be the 5-dimensional Hausdorff measure with respect 
to (U, /), restricted to A(r). 

We begin by recalling Apollonian circle packings, whose construction 
is based on the following theorem of Apollonius of Perga: 

Theorem 8.1 (Apollonius, 200 BC). Given 3 mutually tangent circles 
in the plain (with distinct tangent points), there exist precisely two 
circles tangent to all three circles. 

Consider four mutually tangent circles in the plane with distinct 
points of tangency. By the above Apollonius' theorem, one can add 
four new circles each of which is tangent to three of the given ones. 
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Continuing to repeatedly add new circles tangent to three of the pre- 
vious circles, we obtain an infinite circle packing, called an Apollonian 



circle packing. Figure 8.1 shows the first three generations of this pro- 
cedure where each circle is labeled with its curvature (the reciprocal of 
its radius). 

8.2. Apollonian packing and Hausdorff measure. We start by 
recalling: 

Definition 8.2. For s > 0, the s-dimensional Hausdorff (also known 
as covering) measure H, s of a closed subset E of M 2 is defined as follows: 

W{E) : = lim inf diam(A)" : E C U ieI D h diam(A) < e}. 

e ^ iel 

The Hausdorff dimension of E is then given as 

dim H (E) := sup{s : U S (E) = oo} = inf{s > : W(E) = 0}. 

For s a positive integer, the s- dimensional Hausdorff measure is pro- 
portional to the usual Lebesgue measure on R s . 

The residual set Res(P) is defined to be the closure of the union of 
all circles in V. Its Hausdorff dimension, say a, is independent of V 
and known to be approximately 1.30568(8) [29] . 

Theorem 8.3. Let V be any Apollonian circle packing. For any con- 
formal metric (U, f) and for any compact subset E C U with smooth 
boundary, we have 

limt a/2 • #{C7 G V : area f (C) > t, C n E ^ 0} = c A ■ W}(Res(V) fl E) 



where ca> is independent of V and dl-i c . 



f(z) a ■ dW 



The symmetry group T-p := {g G PSL 2 (C) : g{V) = V} satisfies the 
following: 

(1) is geometrically finite. 

(2) The limit set of Tp coincides with Res('P); in particular, its 
critical exponent is a. 

(3) There are only finitely many T-p-orbits of circles in V. 
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Let u-pj denote the PS measure viewed from j = (0, 0, 1) G H 3 for 
the group T-p. As T-p has no rank 2 parabolic limit points and a > 1, 
Sullivan's work [46] implies that the a- dimensional Hausdorff measure 
T-L a is a locally finite measure on Res(P) and that 



i\z\ 2 + i) a diy VJ = dn c 



Therefore Theorem 8.3 is a special case of Theorem 7.5 Moreover the 



constant ca is given by 



W 2 • sk rp (P) • 






m BMS 





for any Apollonian circle packing V. We propose to call ca the Apol- 
lonian constant. 

Problem 8.4. Compute (or estimate) ca! 

When V is a bounded Apollonian circle packing, the existence of the 
asymptotic formula #{C G T 3 : area(C) > t, } ~ op • t a ^ 2 was first 
shown in EU without an error term, and later in [271 with an error 



term (see also [IS]). In view of |36j, Theorem 5.6| can be used to prove 
an effective circle count in a compact region E for general Apollonian 
packings, provided the boundary of E satisfies a regularity property. 

There is also a beautiful arithmetic aspect of Apollonian circle pack- 
ings which is entirely omitted in this article. We refer to [4"3] ; [55] . [5], 
[9], etc. 

8.3. Apollonian sphere packing for n = 3. Given n + 1 mutually 
tangent spheres in W 1 with disjoint interiors, it is known that there is 
a unique sphere, called a dual sphere, passing through their points of 
tangency and orthogonal to all (n + 1) spheres [181 Thm 7.1]. Hence for 
(n + 2) mutually tangent spheres with disjoint interiors Si, • • ■ , S n+ 2 in 
]R n , there are (n + 2) dual spheres, say, Si, • • • , S n+ 2. The Apollonian 
group ^4 = *A(Si, • • • , S n+2 ) is generated by the inversions with respect 
to S h 1 < i < n + 2. 

Only for n = 2 or 3, the Apollonian group A is a discrete subgroup 
of MG(M n ) [TBI Thm 4.1] and in this case its orbit V := U"+ 1 2 ^(S i ) 
consists of spheres with disjoint interiors. For n = 2, V is an Apol- 
lonian circle packing. For n = 3, V is called an Apollonian sphere 
packing. Note that A is geometrically finite and that V is locally fi- 



nite, as the spheres in V have disjoint interiors, Hence Theorem 7J3 
applies to V . The critical exponent of A for n = 3 has been estimated 
to be 2.473946(5) in [1]. 
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8.4. Dual Apollonian Cluster Ensemble for any n > 2. Given 
(n + 2) mutually tangent spheres with disjoint interiors Si, - ■ ■ , S n+ 2 in 
W 1 , let A* denote the group generated by the inversions with respect 
to Si, 1 < i < n + 2. The dual Apollonian group A* is a discrete 
geometrically finite subgroup of MG(IR n ) for all n > 2 and the orbit 
V := U™=iA*(Si) is a sphere packing, in our sense, consisting of spheres 
nested in Si's. We note that V is locally finite, as nested spheres are 
getting smaller and smaller and hence Theorem 7.5 applies to V . 



9. Packing circles of the ideal triangle in H 2 

Consider an ideal triangle T in H 2 i.e., a triangle whose sides are 
hyperbolic lines connecting vertices on the boundary of HI 2 . An ideal 
triangle exists uniquely up to hyperbolic congruences. Consider V(T) 
the circle packing of an ideal triangle by filling in largest inner circles. 
The notation V(T) denotes the closure of V(T) and areajjyp (C) is the 
hyperbolic area of the disk enclosed by C . 

Theorem 9.1 (Packing circles of the ideal triangle). Let T be the ideal 
triangle ofM 2 . Then 

lim t a / 2 ■ #{C G V{T) : area Ryp (C) > t} = c A ■ f y~ a dU a {z) 

*-+0 J-p(T) 

where ca denotes the Apollonian constant. 

Fix the Apollonian circle packing P generated by two vertical lines 
x = ±1 and the unit circle {\z\ = 1}. The corresponding Apollonian 
group T = r(7- > o) is generated by the inversions with respect to hor- 
izontal lines y = and y = —2i and the circles {\z — (±1 — z)| = 1}. 
We set IR 2 ^ := {x + iy : y > 0}. Now for the conformal metric 
(U,f) = (Rl,l/y) = H 2 , we note that {C E V{T) : area Hy p(C) > 
t} = {C e V : are a/ (L7) > t, C n T ^ 0}. 

However Theorem |9.1| does not immediately follow from Theorem 
8.3 since the ideal triangle T is not a compact subset of H 2 . 



We need to understand the "H^-measure of neighborhoods of cusps 
in the triangle for / = 1/y. For the next two theorems, consider a 
conformal metric (IR 2 ^,/). 

Theorem 9.2. If f(x + iy) y~ k for some k > a^ 1 with implied 
constant independent of \x\ < 1, then for any f] > 0, 

Hf{\x\ < l,y > T]} < oo. 
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Moreover for any Borel E C {|x| < l,y > r]} (not necessarily compact) 
with smooth boundary, 

lim t a/2 ■ #{C G V : areaAC) > t,C R £ ^ 0} ~ c A ■ U a AE). 

Proof. It suffices to show the claim for any 77 > fixed. We put 77 = 1 
and set U R := {\x\ <l,y> R}. Define F t (E) := {C G V : area/(C) > 
t,C n E ^ 0} and £ n := {|x| < l,n < y < n + 1}. Then F t (Z7i) = 

U n >l-P*(-E'n)- 

For C <E E n , C - (n - l)i G and 



area(C — (n — = I 

Jc 



f{zfdz 

C-(n-l)i 



f(z + (n- l)i)) 2 dz < n~ 2fc area(C). 



j T \n — ^ •/,' lh • 

>C 

Hence we get an injective map F t (E n ) to F tn -2k(Ei) and hence for 
Ro>l, 

n>Ro 

By Theorem 8.3[ for e > 0, there exists t t such that for all t < t e , 

and hence there exists N e > 1 such that for allt < 1 and n > N e , 
#F tn - 2k (Ei) < r^n-^CAiH^EA + e) 

and hence 

m(U N Jt a / 2 < ( J2 n-^CAinjm + e). 

n>N t 

Since i^2 n>Ne n~ ka ) < 00 as ka > 1, if iV e 1 is sufficiently large, 
we can make #F t (U N )t a / 2 < e and H a f {U Ne ) < e. Hence 

limsup#F t (?7 1 )t a / 2 = limsup# ^ F t (E n )t a / 2 +0(e) = c A -U a f (Ui)+0(e) 

l<n<N e 

As e > is arbitrary, we have 

lim sup #^([70 W 2 = c A ■ H^Ui). 

Similarly we have lim inf #F t {Ux)t a / 2 = c A ■ H a f {U x ). □ 

We note that the boundary of M? + meets with Res('Po) a t three points 
1, — l,oo and these three points are in one r -orbit. Note that T 
contains an element 7 : 70(2; + yi) = x + (y + 2)i. 
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Theorem 9.3. Let (R 2 ^, /) be a conformal metric such that f(x+iy) x 
y~ k for feel. 

(1) //a" 1 < k < 2 - a -1 , we /wwe "H^(R^) < oo. 

(2) If either k < a' 1 or k > 2 — oT x , we have %"(R+) = oo. 

Proof. Let 7(2) = =£rjr ■ Then 7 G T and 7(00) = 1. Hence if we set 
:= {|x| < 1, y > 77}, 7(t/ r) ) is a neighborhood of 1 for all large r] > 1. 
We will show that Hf(^(U v )) < 00 if fc < 2 
We have 



a 



-1 



W,)) = / f(z) a dH a (z) 



fMw)) a WW\ a dH a (w) 

w£U v 



Since |7'( w )| = |iu — 1 + i\ 2 and ^(^(w)) x y 1 , we have 

/(7H)|7'H|x/- 2 . 



Hence by Lemma 9.2 if 2 — > a 1 , 

njijiu,)) < 00. 



□ 



Note that T : = "Po H R+ is a circle packing of the curvilinear triangle 
made by largest inner circles. 

As a > 1, Theorem 9T is a special case of the following: 

Theorem 9.4. Lei (R+, /) be a conformal metric such that f(x+iy) x 
y~ k where a~ l < k < 2 — oT x . Then for any Borel subset E C R 2 ^ (not 
necessarily compact) with smooth boundary, we have 

lim t a ' 2 ■ #{C7 e T : areaAC) > t,C D £ ^ 0} ~ C4 ■ Ti%E). 



References 

[1] Martine Babillot. On the mixing property for hyperbolic systems. Israel J. 

Math., 129:61-76, 2002. 
[2] Yves Benoist and Hee Oh. Effective equidistribution of S-integral points 

on symmetric varieties To appear in Annates de L Tnstitut Fourier, 

larXiv:0706. 16211 

[3] A. Borel and H. Garland. Laplacian and the discrete spectrum of an arithmetic 
subgroup. Amer. J. Math. 105 (1983), 309-335 

[4] M. Borkovec, W. De Paris and R. Peikert. The fractal dimension of the Apol- 
lonian sphere packing Fractals, 2:521-526, 1994. 

[5] Jean Bourgain and Elena Fuchs. A proof of the positive density conjecture for 
integer Apollonian packings J. Amer. Math. Soc. 24, 945-967, 2011 



28 HEE OH 

[6] Jean Bourgain, Alex Gamburd, and Peter Sarnak. Affine linear sieve, ex- 
panders, and sum-product Inventiones 179, (2010) 559-644 

[7] Jean Bourgain, Alex Gamburd, and Peter Sarnak. Generalization of Selberg's 
3/16 theorem and Affine sieve To appear in Acta M. 

[8] Jean Bourgain, Alex Kontorovich, and Peter Sarnak. Sector estimates for hy- 
perbolic isometries GAFA 20, (2010) 1175-1200 

[9] Jean Bourgain and Alex Kontorovich. On the strong density conjecture of 
Apollonian packings Preprint. arXiv:1205:4416, 2012 
[10] B. H. Bowditch. Geometrical finiteness for hyperbolic groups. J. Funct. Anal., 

113(2):245-317, 1993. 
[11] Marc Burger. Horocycle flow on geometrically finite surfaces. Duke Math. J., 
61(3):779-803, 1990. 

[12] H. S. M. Coxeter. The problem of Apollonius. Amer. Math. Monthly, 75:5-15, 
1968. 

[13] Dmitry Dolgopyat On decay of correlations in Anosov flows Ann. Math, 
147:357-390, 1998 

[14] W. Duke, Z. Rudnick, and P. Sarnak. Density of integer points on affine ho- 
mogeneous varieties. Duke Math. J., 71(1):143 179, 1993. 

[15] Nicholas Eriksson and Jeffrey C. Lagarias. Apollonian circle packings: number 
theory. II. Spherical and hyperbolic packings. Ramanujan J., 14(3):437-469, 
2007. 

[16] Alex Eskin and C. T. McMullen. Mixing, counting, and equidistribution in Lie 
groups. Duke Math. J., 71(l):181-209, 1993. 

[17] L. Flaminio and R. Spatzier. Geometrically finite groups, Patterson-Sullivan 
measures and Ratner's theorem. Inventiones, 99, 601-626 (1990) 

[18] R. L. Graham, J. C. Lagarias, C. L. Mallows, A. R. Wilks, C. H. Yan. Apol- 
lonian circle packings: geometry and group theory. III. Higher dimensions. 
Discrete and Computational Geometry., 35:37-72, 2006. 

[19] Ronald L. Graham, Jeffrey C. Lagarias, Colin L. Mallows, Allan R. Wilks, and 
Catherine H. Yan. Apollonian circle packings: geometry and group theory. I. 
The Apollonian group. Discrete Comput. Geom., 34(4):547-585, 2005. 

[20] Colim Guillarmou and Rafe Mazzeo. Spectral Analysis of the Laplacian on 
geometrically finite hyperbolic manifolds Inventiones, 187 (2012), 99-144 

[21] Roger Howe and Calvin Moore. Asymptotic properties of unitary representa- 
tions J. Fund. Anal, 72-96, 1979. 

[22] Inkang Kim. Counting, Mixing and Equidistribution of horospheres in geomet- 
rically finite rank one locally symmetric manifolds Preprint, arXive: 1103. 5003 

[23] D. Y. Kleinbock and G. A. Margulis. Bounded orbits of nonquasiunipotent 
flows on homogeneous spaces. In Sinai's Moscow Seminar on Dynamical Sys- 
tems, volume 171 of Amer. Math. Soc. Transl. Ser. 2, pages 141-172. Amer. 
Math. Soc, Providence, RI, 1996. 

[24] Alex Kontorovich and Hee Oh. Apollonian circle packings and closed horo- 
spheres on hyperbolic 3-manifolds. Journal of AMS, Vol 24. 603-648, 2011. 

[25] Bertram Kostant. On the existence and irreducibility of certain series of rep- 
resentations Bull. Amer. Math. Soc, Vol 75. 627-642, 1969. 

[26] Peter D. Lax and Ralph S. Phillips. The asymptotic distribution of lattice 
points in Euclidean and non-Euclidean spaces. J. Fund. Anal, 46(3):280-350, 
1982. 



COUNTING 



2!) 



[27] Min Lee and Hee Oh. Effective circle count for Apollonian packings and closed 
horospheres To appear in GAFA. arXiv:1202.1067| 

[28] Gregory Margulis. On some aspects of the theory of Anosov systems. Springer 
Monographs in Mathematics. Springer- Verlag, Berlin, 2004. With a survey 
by Richard Sharp: Periodic orbits of hyperbolic flows, Translated from the 
Russian by Valentina Vladimirovna Szulikowska. 

[29] C. T. McMullen. Hausdorff dimension and conformal dynamics. III. Compu- 
tation of dimension. Araer. J. Math., 120(4):691-721, 1998. 

[30] Amir Mohammadi and Hee Oh. Ergodicity of unipotent flows and Geometri- 
cally finite Kleinian groups Preprint, arXiv:1112.4024 

[31] Amir Mohammadi and Hee Oh. Matrix coefficients and Effective counting for 
gometrically finite groups. Preprint, 2012 

[32] Amos Nevo and Peter Sarnak. Prime and Almost prime integral points on 
principal homogeneous spaces Acta Math, 205 (2010), 361-402 

[33] Hee Oh. Dynamics on Geometrically finite hyperbolic manifolds with applica- 
tions to Apollonian circle packings and beyond. Proc. of ICM. (Hyperabad, 
2010), Vol III 1308-1331 

[34] Hee Oh. Orbital counting via mixing and unipotent flows In Homogeneous 
flows, Moduli Spaces and Arithmetic, Clay Math. Porceedings 2010, Vol 10, 
339-375 

[35] Hee Oh and Nimish Shah. Equidistribution and counting for orbits of geomet- 
rically finite hyperbolic groups. To appear in JAMS. |arXiv:1 001.2096 

[36] Hee Oh and Nimish Shah. The asymptotic distribution of circles in the orbits 
of Kleinian groups. Inventiones, Vol 187, 1-35, 2012 

[37] S.J. Patterson. The limit set of a Fuchsian group. Acta Mathematica, 136:241- 
273, 1976. 

[38] J. G. Ratcliffe. Foundations of hyperbolic manifolds. Springer- Verlag, GTM 
149 

[39] Marina Ratner. On Raghunathan's measure conjecture. Ann. of Math. (2), 
volume 134, 1991. 

[40] Thomas Roblin. Ergodicite et equidistribution en courbure negative. Mem. 

Soc. Math. Fr. (N.S.), (95):vi+96, 2003. 
[41] A. Salehi Golsefidy and P. Sarnak. Affine Sieve preprint. arXiv: 1109. 6432 
[42] A. Salehi Golsefidy and P. Verju. Expansion in perfect groups preprint. 

larXiv:1108.4900l 

[43] Peter Sarnak. Integral Apollonian packings. Amer. Math. Monthly. 118 (2011), 
291-306 

[44] Peter Sarnak. Letter to J. Lagarias, 2007. available at 
www.math.princeton.edu/ sarnak. 

[45] Dennis Sullivan. The density at infinity of a discrete group of hyperbolic mo- 
tions. Inst. Hautes Etudes Sci. Publ. Math., (50):171-202, 1979. 

[46] Dennis Sullivan. Entropy, Hausdorff measures old and new, and limit sets of 
geometrically finite Kleinian groups. Acta Math., 153(3-4):259-277, 1984. 

[47] L. Stoyanov. Spectra of Ruelle transfer operators for axiom A flows Nonlin- 
earity, 24 (2011), 1089-1120 

[48] Ilya Vinogradov. Effective bisector estimate with applications to Apollonian 
circle packings, preprint, 2012, arXiv. 1204.5498 



30 



HEE OH 



[49] Garth Warner. Harmonic Analysis on scmisimple Lie groups I. Die 

Grundlehren der mathematischen Wissenschaften, Band 188. Springer- Verlag 

New York-Heidelberg, 1972. 
[50] Garth Warner. Harmonic Analysis on semisimple Lie groups II. Die 

Grundlehren der mathematischen Wissenschaften, Band 189. Springer- Verlag 

New York-Heidelberg, 1972. 

Mathematics department, Brown university, Providence, RI 02912 
and Korea Institute for Advanced Study, Seoul, Korea 
E-mail address: heeori@matri.brown.edu 



